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Abstract 


This study aimed to develop and test the psychometric properties of the self-administered academic life satisfaction scale 
(ALSS) in a Portuguese sample of undergraduate students. An instrument development design process and psychometric 
study was performed. The data were collected between October and December 2016 in Lisbon campuses. The content 
and face validity analysis were performed by using a focus group. The ALSS’s psychometric study was performed on a 
500-undergraduate student’s convenience sample. The participants were invited to fill out an online questionnaire: 
sociodemographic data; one self-perception question about academic performance; and the ALSS. The Principal 
Component Analysis (PCA) and Cronbach’s a internal consistency was performed. The reliability, verified through 
internal consistency, showed to be adequate (Cronbach’s a =0.80). A two-dimensions structure construct validity was 
established by PCA, explaining 42.90% of total variance. The criterion validity was demonstrated by positive significative 
correlations between ALSS academic self-perception performance. The ALSS is a valid, reliable and very brief self- 
response instrument that is now available to measure academic life satisfaction among Portuguese students. It can be 
used to support more accurate health promotion programs in the campuses to improve student’s academic success, 


wellbeing and mental health. 
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Abbreviations: ALSS: Academic Life Satisfaction Scale; Introduction 
ALS: Academic Life Satisfaction; SSQ: Student Satisfaction 
Questionnaire; CSS: College Student Survey; SSI: Student Background 


Satisfaction Inventory; ASQ: Academic Satisfaction 
Questionnaire; ASSCS: Academic Satisfaction Scale for 
College Students; PCA: Principal Components Analysis. 


The Academic Life Satisfaction Scale (ALSS) measure 
the student's academic experiences on campus and the 
quality of their adjustment to the academic life and 
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environment. The development procedure of the ALSS is 
based on the literature review and Multidimensional 
Model of Adjustment of Young People to the University 
context [1]. 


Currently, academic life satisfaction (ALS) plays an 
important role im campus, both as a key indicator of 
students’ well-being, as well as an institutional measure of 
success and effectiveness [2]. ALS refers to the student’s 
perception of positive feelings and attitude towards 
his/her learning activities [3]. Globally encompasses 
student life experiences in the academic environment and 
shows the quality of campus [4,5]. Happy students with 
their studies (considered “satisfied”) adopts an active 
learning attitude, while unhappy’s (considered 
“dissatisfied”) adopts a negative or passive attitude [6]. 
The degree of student satisfaction is the margin between 
“level of anticipation” and “actual results” so, a smaller 
margin would mean greater satisfaction and a larger 
margin would mean lower satisfaction [7]. 


In addition, ALS is a complex multifactorial construct 
that includes a broad of students’ life experiences on 
campus and shows the quality of students’ adaptation to 
academic environment. These aspects have leading to a 
debate centred on ALS’s construct and measurement [3]. 
Therefore, over the past two decades the discussion about 
students’ ALS reliable instruments remains [8]. literature 
review point out three aspects to be considered to 
measure students’ ALS: (1) higher education transition is 
a vulnerability period with multiple and complex 
adjustment tasks and setting specificities; (2) adaptation 
tasks involve students’ personal characteristics and may 
disturb their health and performance (3) students’ ALS 
play a significant role in measuring institutional 
effectiveness [1,3,9]. 


Overall, authors agree that transition and adjustment 
to academic life is a major challenge for freshman, that 
involves academic satisfaction, developmental aspects 
(personal, social and vocational), as well the academic 
environment and features of attended campus [10]. The 
positive accomplishment of this transition includes 
academic satisfaction, which in turn depends on the 
degree of each surpassed challenge by the students. 
Currently, the main developmental students tasks 
involved in this period are grouped in four domains: (a) 
academic - to continuous adaptations to new learning 
strategies, teaching and evaluation system; (b) personal - 
to establish identity, expand self-awareness, develop self- 
esteem and a personal view of the world; (c) social - to 
develop. progressively more mature interpersonal 
relationships (family, colleagues, teachers, colleagues of 
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the opposite sex and authority figures); (d) vocational - to 
strength vocational identity and decision making, to 
explore and commit with professional goals [3,11]. 


Because student’s ALS involves a_ complex 
multifactorial process of experiences (personal, affective, 
cognitive aspects and institutional features and facilities), 
it is difficult to limit and identify the ALS’s construct 
components [3]. Hence, there is no consensus about to 
how to measure the students’ ALS accurately [9,12]. 
However, understanding the underlying dimensions of 
student’s ALS as well the factors that contribute to 
student’s satisfaction has a great potential benefit for 
institutions, students and society [8]. 


Literature Review 


Literature shows a lack of instruments to gather data 
about students’ self-perceptions of academic satisfaction 
and experiences on campus [4]. Nevertheless we find 
some relevant instruments such as: the Student 
Satisfaction Questionnaire [13], with 70 items and 5 
subscales (comprehension, social life, work conditions, 
recognition and educational quality); the College Student 
Survey [14], with 27 items and 5 subscales (curriculum 
and teaching, services and support, student life, 
relationships with teachers and _ conditions and 
equipment); and the Student Satisfaction Inventory [15], 
original version (79 items) and the short one (6 items). 
Yet, these instruments assign insufficient attention to 
interpersonal (relations), academic (course) and setting 
(institution) dimensions, covering merely intrapsychic 
variables, such as cognitive and psychosocial aspects 
[12,7]. 


In the late nineties, in Portugal, some instruments 
were developed to screen and study Portuguese students’ 
adjustment processes to obtain success in the first years 
of college. Mostly based on MMAU model [12,3], point that 
student’s academic adjustment does not occur dissociated 
from human’s development or learning processes, on the 
contrary, it covers dimensions such as: satisfaction with 
the pedagogical relationships with teacher; physical 
environment and facilities of the campus; personal 
commitment to the course; extracurricular activities on 
campus; setting facilities to study; students skills and 
competences; self-perception of academic performance; 
and relationship with colleagues and teachers [1,3,4]. 


In the scope of MMAU’s the concept of ALS is 
grounded on student’s personal issues and academic 
setting. From this point of view, ALS is the students’ 
subjective assessment of the quality and value of the 
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academic experience, combining cognitive and affective 
components. This model covers students' personal 
characteristics, interpersonal relationship with teachers 
and colleagues, the quality of the curriculum and teaching, 
as well the conditions provided by the campus 
environment [3,12]. 


A second perspective, defines ALS as_ students’ 
perception about the educational experience that includes 
the personal commitment and involvement with the 
college, and the decision to stay or leave the college. It 
covers cognitive-affective dimensions (socio-relational, 
personal, interpersonal, institutional and curricular 
aspects), and circumstantial settings of the campus 
(grounds, buildings and arrangements) [2]. This 
conception accepts that ALS is a dynamic concept, so it is 
variable along students’ academic path, as well influenced 
by them personal characteristics [1,7]. 


In Portuguese-speaking countries, regardless the lack 
of tools to measure ALS, literature review show four 
important self-report instruments: (1) Questionnaire of 
Academic Experience [2], with 60 items and 5 dimensions’ 
structure: personnel (13 items a=0,87); interpersonal (13 
items a=0,86); career (13 items a=0,91); learning (13 
items a=0,82); institutional (8 items a=0,71), that explain 
41,7% of the variance. The Brazilians short version [16], 
has 55 items and the same 5 dimensions and total 
Cronbach's alpha is 0,88; (2) The Academic Satisfaction 
Questionnaire [2], with 13 items and 3 dimensions: 
curricular satisfaction (5 items a= 0,74); satisfaction with 
the institution (4 items a= 0,64); socio-relational 
satisfaction (4 items a= 0,66), that explain 51% of the 
variance and total Cronbach's alpha = 0,78; (3) the 
Satisfaction with Academic Experience Scale [17], with 35 
items and 3 dimensions: satisfaction with course (13 
items a= 0,90); opportunities and development (10 items 
a= 0,87); satisfaction with the institution (11 items a= 
0,87) that explain 47,7% of the variance and total 
Cronbach's alpha=0,94 and subsequent studies also show 
good psychometric properties [3]; (4) and the Academic 
Satisfaction Scale for College Students [12], with 35 items 
and 4 dimensions: pedagogic milieu (11 items a= 0,87); 
affectivity (10 items a= 0,76); campus milieu (7 items a= 
0,73); self-esteem (7 items a= 0,72) that explain 41,8% of 
the variance. 


However, despite the evidence of good psychometric 
properties, in terms of validity and precision, most of the 
instruments above differ in terms of variables and 
dimensions, showing some lack of constructs strength 
[3,5,7]. Also, they are to extensive, meticulous or very 
specific and do not address important aspects of ALS 
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construct - such as personal and setting elements, which 
are central dimensions to adjustment process to college 
[4]. We decided to develop a new potential instrument to 
measure ALS based on a theoretical framework that 
contents the student’s unique perception of life 
satisfaction and the peculiarities of campus, both 
dimensions equally involved on students’ academic life 
experience. Hence, the purpose of this study is to develop 
and to test psychometric properties on the self- 
administered ALSS in a Portuguese student’s sample. 


Methods 


Participants 


The pilot version of the ALSS was tested in a sample of 
500 freshmen and sophomore students attending Military, 
public and private universities and institutes from Lisbon 
district, Portugal. We appraised the sample size sufficient 
to obtain sensible psychometric estimations and we set 
up the inclusion criteria: aged between 18 and 24 years 
old; and to be Portuguese native speaker. The inquiry 
form to collect information was anonymous and voluntary. 
The return fill rate was 68%. 


Materials 


To collect data we use: an sociodemographic form 
with six items (sex, marital status, hometown, area of 
study, year of attendance); a single self-classification 
question to measure student’s self-perception of 
academic performance (rating in a 5-point Likert-type 
scale; range from 1= very low to 5= excellent); and the 
ALSS pilot version - a eight-items self-report instrument 
designed by the authors to measure student’s ALS, which 
comprises academic experiences and good adjustment to 
the academic life on campus. The ALSS yields a global 
score and two dimensions: (1) Personal Satisfaction 
(internal - students’ skills and competences, perception of 
academic performance and relationships with colleagues 
and teachers; items 5, 6, 7, 8) and (2) Satisfaction with the 
Academic Environment (external - physical, pedagogical 
environment, interest and commitments to the course, 
extracurricular activities of the institution, conditions for 
study; items 1, 2, 3, 4). It rates in a 5-point Likert-type 
scale, all positive (range from: 1 =Strongly disagree; 2 
=Strongly disagree; 3 =Neither agree nor disagree; 4 
=Agree; 5 =I totally agree). ALSS's total score is the sum of 
all items, that can vary from a minimum of eight to a 
maximum of forty. The higher value of ALSS, the best 
student's self-perception of academic life satisfaction in 
campus. 
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Procedure 


Based on literature review, frist a list of items was 
carefully selected regarding to: personal, career, 
interpersonal, study, satisfaction with the course, 
opportunity for development and satisfaction with the 
institution, from two instruments, underlying theoretical 
MMAU model variables. Second, we used ten students 
focus group interview methodology to select the most 
relevant items (score rank) that express events and issues 
that occur during life in campus. This group items were 
reviewed by an expert panel to verify the clarity, 
pertinence and suitability of the selected items. Finally, a 
pilot version facial validity was appraised by a different 
group of fifteen students using the Thinking Aloud 
Method [18], to analyse the adequacy, acceptability of the 
items and to check if the wording used was clear. After 
minor lexicon adjustments, a corrected eight items pilot 
version was produced named ALSS. 


After formal authorizations, all students were invited 
to participate. The data was collected during October to 
December 2016 thru an online query using an access link 
sent to students’ campus email. After logged in on 
platform, students had to validate the Informed Term of 
Consent to access and fill the socio demographic, 
academic information and other measures. 


Statistical analysis was performed with SPSS 20.0. 
Psychometric evaluation of the ALSS was conducted in 
successive phases. To determine item-to-total 
correlations, item-to-dimension correlations and total 
Cronbach’s alpha we use Personal Satisfaction and 
Satisfaction with the Academic Environment dimensions. 
To determine the underlying factor structure in the ALSS 
was used the Principal Components Analysis (PCA). 


Convergent validity was examined using Spearman 
correlation coefficient (rho). We assumed that adequate 
reliability would be coefficients above 80, for both 
analyses. 


The present investigation complies with all ethical 
principles assumed by Helsinki Declaration and Human 
Subjects Protection; in addition it was approved by the 
Ethics Committee Review Board of the _ institutions 
involved. All participants were previously asked to 
validate written informed consent before voluntarily fill 
the online survey form, provided with information on the 
purpose and implications of the study. Also, they were 
informed that all data would remain anonymous, and 
without any possibility of identifying the participants. All 
were informed of their right to withdraw from the study 
at any time. 


Results 


A 500 non-probabilistic sample of higher education 
students, with average age of 19.60 years (range 18-24), 
mostly female (99.30%) and single (79.60%). The 
majority (78.80%) attend public institutions and military 
(3,90%); 2nd year (51.10%) and mostly (61.30%) health 
courses. A large number perceives academic performance 
as good (60.90%) and 1.30% as excellent. The results 
display on Table 1 show a moderate satisfaction with 
academic life (M=29.20; SD=5.33). The Personal 
Satisfaction (M=14.61; SD=2.90) obtained a slightly higher 
value than Satisfaction with Academic Environment 
(M=14.59; SD=3.20). The Item 2 got the highest value of 
mean satisfaction (M=4.24) and item 3 the lowest 
(M=2.97). 


ALSS M DP 
8. lam satisfied with the relationship that I have with the teachers 3.68 0.9 
6. I am satisfied with my academic performance 3.39 0.96 
5. | am satisfied with my commitment to my course 3.63 1.01 
7.1 am satisfied with the relationship that I have with my colleagues on campus 3.91 1.02 
Personal Satisfaction @ a= .72 14.61 2.92 
4.1 am satisfied with the conditions for studying at campus 3.47 1.17 
1. am satisfied with the institution of higher education that I attend 3.92 1.02 
3. 1am satisfied with the extracurricular activities of the institution I attended 2.97 1.21 
2. lam satisfied with the course I attended 4,24 0.92 
Satisfaction with Academic Environment ©) q=.74 14.59 3.19 
Total Scale a= .80 29.2 5.33 


(a) 4 Items [4;20]; (b) 4 items [4;20]; (c) ALSS [8;40] 


Table 1: Means, SD and internal consistency of ALSS’ items and components. 
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The independence of the items was studied using 
Pearson's inter-item correlation Table 2. All correlations 
were positive, significant (a = 0.01) and ranged between 


the lower r = 0.12 and higher value r = 0.62. The corrected 
item-total correlation varied between 0.40 and 0.56. Only 
item 6 had a lower value, yet acceptable. 


Items ESS 
2 3 4 5:00 AM 6:00 AM 7:00 AM 8:00 AM 
16 0.52 0.38 0.5 0.38 0.3 0.3 0.34 
2» 0.29 0.3 0.55 0.39 0.17 0.31 
3b 0.4 0.36 0.26 0.2 0.27 
4b 0.34 0.17 0.12 0.24 
5 0.62 0.35 0.45 
6 0.26 0.42 
7 0.45 
(a) Personal Satisfaction; ©) Satisfaction with Academic Environment 


Table 2: Pearson Correlations ALSS inter-item. 


To investigate ALSS’s psychometric qualities we 
search for evidence of validity related to the internal 
structure and dimensions. The Principal Components 
Analysis (PCA) extraction factor method was performed 
with Varimax Orthogonal Rotation, which assumes the 
independence between the bent factors. The results of 
Bartlett's sphericity test [Chi-square (28) =1198.968; P= 
0.00 <0.001] indicates that the correlations between the 
items are suitable to carry out the analysis. The Kaiser - 
Meyer - Olkin measurement (KMO= 0.77> 0.5) confirmed 


the fitness of the sample for the factorial analysis, and all 
Anti-Matrix values were higher than 0.71 (assuming 0.30 
as minimum acceptable of practical significance by 
Maréoco [19]. The results of initial PCA analysis showed 
that two components obeyed the Kaiser criterion, and the 
scree plot Figure 1 showed two components placed before 
the curve inflection. So, considering the sample size and 
the convergence between the scree plot and the Kaiser 
criterion, it was decided that 2 was the number of 
components to kept in the final analysis. 


Total Variance Explained 
Initial Eigenvalues Total 


fe 


Values 


Component 


Figure 1: Scree Plot Components of the ALSS. 


T T T T 


Table 3 shows the structure and components of the 
ALSS (Varimax Factor Analysis - Orthogonal Rotation). 
Rotated matrix showed that items 5, 6, 7 and 8 had a 
higher load on component 1 - Personal Satisfaction, and a 


whose relationship with factor 2, ranged from 0.68 to 0.74. 


The items 1, 2, 3 and 4, had a higher load in Component 2 
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- Satisfaction with Academic Environment, and the ratio 
ranged between 0.54 and 0.83. The eigenvalue of 
Component 1 explains 29.50% of the variance and 
Component 2 explains 27.70%. The Component 1 best 
explains the total variance of 43.10%, while the the 
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second explains 14.20%. Both Components explain an 


accumulated variance of 57.24%. 


Components 

Items 1 2 
SP 8 - I am satisfied with the relationship that I have with the teachers 0.74 
SP 6 - | am satisfied with my academic performance 0.73 
SP 5 - 1 am satisfied with my commitment to my course 0.71 
SP 7 - I am satisfied with the relationship that I have with my colleagues at campus 0.68 
SAE 4 - 1 am satisfied with the conditions for studying at campus 0.8 
SAE 1 - 1 am satisfied with the institution of higher education that I attend 0.7 
SAE 3 - I am satisfied with the extracurricular activities of the institution I attended 0.7 
SAE 2 - I am satisfied with the course I attended 0.5 
Eigenvalues 2.36 2 
% explained variance 29.5 28 
% cumulative explained variance 43.1 57 
PS - Personal Satisfaction; SAE-Satisfaction with Academic Environment; (a) varimax orthogonal rotation method with 

Kaiser normalization. 


Table 3: Structure (a) and components of ALSS. 


The two subscales of ALSS, empirically created, 
contain items that represent the intrinsic characteristics 
of each factor theoretically supported the Personal 
Satisfaction consists of items that represent 
predominantly personal features while Satisfaction with 
Academic Environment comprises contextual aspects of 
satisfaction with academic life. 


The reliability of ALSS was assessed through internal 
consistency, using Cronbach's alpha coefficient. Accuracy 
of the ALSS items is display on Table 3. Results indicate 
good reliability for total scale a=0.8, and acceptable for 
both subscales (above the reference value 0.7) and 
considering the reduced number of ALSS items [19]. 


Convergent validity was calculated using Spearman's 
correlation between ALSS and a self-perception single 
question “are you _ satisfied with your academic 
performance?” to measure’ personal academic 
performance. The results show a significant (p <0.01) 
positive correlation between self-perception of academic 
performance and ALSS (r=36), varying from the higher 
intensity in Personal Satisfaction (r=41) to the lowest in 
Satisfaction with Academic Environment (r=,24). 


Discussion 


The purpose of this study was to develop and test 
psychometric properties on the self-administered ALSS in 
a Portuguese student’s sample. We like to highlight the 
importance of the student’s ALS to better understand, 
improve and change campus environments, thereby 
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creating settings more healthy and favourable for 
Portuguese Higher Education student’s development. 
Measuring ALS is an important indicator of the 
institution’s responsiveness to the students’ needs 
[4,8,20], well-being and psychological distress [21]. In this 
sense, we looked for evidence related to a new 
instrument-AlSS, towards reliability, internal structure 
and face validity. 


The results of internal consistency indicate good 
reliability for ALSS’s total scale and acceptable for the two 
subscales. These accuracy results are significant 
considering the small number of items of the ALSS. 
Cronbach's alpha consistency stood above the reference 
value (0.7) suggested by Mardco [19]. Also, 
content validity of ALSS was established. The Principal 
Components Analysis-performed on ALSS‘s items showed 
that the scale is a valid and reliable measure. The results 
display the existence of two dimensions: one linked to 
intrinsic and uniqueness nature of students and, a second 
one more external, related to institutional influences like 
circumstantial issues. This two-dimension structure 
indicates compliance between the underlying construct of 
ALSS and the conceptual framework of the MMAU Model 
[7,3]. This structure configuration is in line with several 
studies that have confirmed the multidimensionality of 
ALS [1, 3,13]. Overall, these results also comply with the 
construct of previous similar instruments, that includes 
several areas related to student’s life and experiences in 
campus, which usually polarize around two areas: inner 
and external dimension namely: personal and _ socio- 
relational satisfaction and _ college characteristics 
environment [3]. Both, individual and environmental, 
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variables have shown to be strongly related to academic 
adjustment as well, made significant contributions to 
predict student’s psychological welfare [9]. Also, ALS is a 
relevant indicator to explain student’s health, self-efficacy 
and stress [22-24]. Similarly, some authors have linked 
higher levels of student’s well-being with higher levels of 
ALS, and there is evidence that student’s ALS influences 
academic success and integration [3,8,25-27] and as a 
predictor of higher education drop-out [5]. The significant 
positive correlations between ALSS and a self-perception 
single question enabled to assess convergent validity with 
alike measure, confirming similarity between the 
underlying constructs of the both measures. Likewise, the 
relevance of ALSS is because it is very short. Hence it is an 
important alternative to the current similar instruments, 
since they are very extensive and exhaustive. 


Since this study is a ALSS’s pilot analysis, authors find 
these results promising, because they add an important 
alternative tool to measure ALS, and so to fill the lack of 
reliable and specific instruments. However, Researchers 
consider that further studies must be carry out to 
reproduce and test psychometric properties of ALSS in 
different samples to confirm and increase the robustness 
of the ALSS, namely stability over time, convergent validity 
and validity in different Portuguese and Portuguese- 
speaking samples. 


In conclusion, the results of the analyses carried out on 
ALSS’s psychometric characteristics have shown to be 
adequate reliable and valid. ALSS is a short self-response 
instrument and is now available to measure academic life 


satisfaction among Higher Education Portuguese students. 


Because ALSS is easily and very brief instrument, it can be 
used as an important alternative tool in research, since 
the existing instruments are very extensive or exhaustive. 
Also, it can be used as a screening tool to support more 
accurate health promotion programs in campuses to 
improve student’s academic success, wellbeing and 
mental health. Despite the usefulness and adequacy of this 
new instrument to evaluate ALS, further studies should be 
carried out to strengthen the psychometric properties of 
ALSS. 


Given the ALSS shows good psychometric properties, 
it is as a suitable, useful and easily tool to measure 
academic life satisfaction, both for clinical and research 
purposes. The results of the study are relevant to nursing 
practice, as they add a new reliable and valid instrument 
to evaluate the student's ALS. Reliable instruments are 
important tools to provide healthcare professionals with 
the necessary assessment mean to increase and improve 
accurate interventions. Given the scarcity of instruments 
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to measure ALS, this novel, short, valid and reliable 
instrument is an asset to practice that may aid how to 
better help students in a variety of settings. 
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